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Abstract 

Background: Indirect reciprocity is a mechanism for cooperation in social dilemma situations, in which 
individuals are motivated to help others to acquire good reputations and receive other's help afterwards. Ingroup 
favoritism is another aspect of human cooperation, with which individuals help members in their own group 
more often than others. Ingroup favoritism is a puzzle for the theory of cooperation because it is not easily 
evolutionarily stable. In the context of indirect reciprocity, ingroup favoritism has been shown to be a 
consequence of a double standard employed by the rule for assigning reputations to individuals; e.g., helping an 
ingroup member is regarded to be good, whereas the same action toward an outgroup member is regarded to be 
bad. 

Results: We analyze a model of indirect reciprocity in which information sharing is conducted groupwise. In our 
model, individuals share reputations about individuals in each group and play a social dilemma game with each 
other within and across groups. We show that evolutionarily stable ingroup favoritism emerges even if all the 
players use a unique reputation assignment rule (i.e., single standard). The two reputation assignment rules 
called simple standing and stern judging yield ingroup favoritism. In particular, stern judging induces much 
stronger ingroup favoritism than simple standing. In addition, we analytically showed as a limiting case that 
pure populations of cooperators that use reputations are unstable when individuals independently infer 
reputations about individuals, which is consistent with previously reported numerical results. 
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Conclusions: Our results suggest that ingroup favoritism can be promoted in indirect reciprocity by the 
groupwise information sharing and that individuals can show ingroup favoritism even without noticing it; they 
simply cooperate with good individuals and defect against bad individuals. 



Background 

Behavioral nature of humans depends on the economy of reputations, where praise and blame often lead to 
gain and loss of material benefits. Humans, among other animals, often cooperate via indirect reciprocity, 
in which individuals cooperate beyond pairwise relationships [l}[4|- In indirect reciprocity based on 
reputations, an individual acquires a good reputation by behaving cooperatively in apposite situations. 
The cost of maintaining a good reputation is compensated by other individuals' upcoming cooperation 
toward individuals possessing good reputations. Indirect reciprocity has been extensively studied in both 
evolutionary and other theory [3 -16 and experiments 17 -20 . 



Another facet of human cooperation is that one often cooperates with members in the same group and 



not with others, phenomenon called the ingroup favoritism 21-29 . Ingroup favoritism poses a puzzle to 
the theory of cooperation because it is usually not Pareto efficient, i.e., the payoff to an individual in the 
case of ingroup favoritism is smaller than that in the case of group-independent all-out cooperation. In 
addition, an individual implementing ingroup favoritism is worse off than an individual defecting against 
both ingroup and outgroup members unless a specific assumption is imposed. In fact, known mechanisms 
for stable ingroup favoritism are, in our view, complicated, e.g., correlation between altruistic traits and 



phcnotypic tags 30-32 , incomplete observability of tags 33 , combination of mutation of tags and limited 
dispersal |34|. Otherwise, stable ingroup favoritism requires an additional mechanism that stabilizes 



cooperation on its own, e.g., intergroup conflict 35 36 



If maintaining a good reputation is a concern, why do individuals want to discriminate between 
ingroup and outgroup fellows? One of the present authors showed that ingroup favoritism is evolutionarily 



stable in various situations when only group-level reputations are available about outgroup members 37 



In that model, reputations about players are assumed to be shared within a group but not across groups. 
It was revealed that the action rule of individuals (i.e., strategy depending on the reputation of the 



2 



coplayer) toward ingroup and outgroup members and the reputation assignment rule (also called the social 
norm) used for evaluating ingroup and outgroup interaction, or at least the latter, must be different for 
stable ingroup favoritism. For example, cooperation toward outgroup members is frowned upon, whereas 
the same behavior toward ingroup members leads to a good reputation. Consistent with this theoretical 
example, Yamagishi and colleagues conducted behavioral experiments before to suggest that ingroup 
favoritism occurs probably because subjects anticipate that the reputation mechanism is functional only 



inside the group 21-23 25 29 . These theoretical and experimental results suggest that double standards, 
in terms of the action rule or the reputation assignment rule, may underpin ingroup favoritism. 

In the context of indirect reciprocity, group structure may play a crucial role in spreading reputations 
about individuals via rumor and gossip. In general, individuals interact more frequently with ingroup 



members than outgroup members 38 . Therefore, rumor and gossip may enable sharing of reputations 
about players more smoothly within a group than between different groups. Most theoretical studies of 
indirect reciprocity assume that information sharing as well as interaction (i.e., game) occur randomly in a 
well-mixed population. Otherwise, individuals are assumed not to exchange the information about 
reputations at all [5}[7|[To|[l6] . 

In the present study, we explore a scenario of ingroup favoritism without resorting to double 
standards. In practice, humans may not differentiate the action rule or reputation assignment rule between 
ingroup and outgroup coplayers. We analyze a group-structured model of indirect reciprocity, in which 
individuals in each group share reputations about each individual. We assume that all the players use the 
same reputation assignment rule. We show that ingroup favoritism can emerge when players simply 
implement reputation-based decision making and do not intend to favor ingroup members. Because of the 
assumed groupwise information sharing and some reputation assignment error, ingroup and outgroup 
members tend to possess good and bad reputations, respectively, without further assumptions. In 
particular, ingroup favoritism is strong when individuals adopt a reputation assignment rule called the 
stern judging, with which helping bad individuals is regarded to be bad. 

Methods 
Model 

We consider an infinitely large population of players divided into M (> 2) groups. Each group is assumed 
to contain the equal fraction, l/M, of players. In the population, players are involved in sufficiently many 
rounds of the so-called donation game. In a one-shot donation game, two players are randomly selected 
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from the population, one as donor and the other as recipient. We assume that the donor and recipient 
belong to the same group with probability 6. The donor cooperates (C), i.e., provides help, or defects (D), 
i.e., refrains from helping, depending on the donor's action rule and the recipient's reputation (good (G) or 
bad (B)). Action C imposes cost c (> 0) on the donor and results in benefit b (> c) imparted to the 
recipient. Action D does not change the payoff to either the donor or recipient. A donor adopting action 
rule ALLC cooperates with any recipient. A donor adopting action rule ALLD defects against any 
recipient. A donor adopting action rule DISC cooperates with G recipients and defects against B recipients. 

To know a recipient's reputation, the donor consults the unique information source, called the 
observer, that is shared by the group to which the donor belongs. This assumption implies that players in 
different groups may perceive different reputations (i.e., G or B) about the same player. The observer in 
each group independently assigns a reputation to the donor and shares it with the other players in the 
observer's group. Observers are assumed to intend the same reputation assignment toward a donor's action 
but may assign a reputation opposite to the intention. The M observers independently commit such 
assignment error with probability fj, (<C 1). In the example of intragroup interaction shown in Fig. [Tj all 
the three observers intended to assign G to the donor, and one observer erroneously assigned B to the 
donor. If the assignment error occurs, the "wrong" reputation is shared by the entire group to which the 
observer belongs. 

Observers assign reputations according to a common reputation assignment rule. We principally 



compare three rules: image scoring (IM), simple standing (ST), and stern judging (JG) 3,4,[7}j9 11 15 



symbolically shown in Fig. [2] Among the three rules, IM is the simplest rule under which observers assign 
G and B to a donor that has selected action C and D, respectively. ST and JG are simplest among the 
so-called "leading eight" reputation assignment rules that stabilize cooperation in well-mixed 
populations [sj[9] . Under ST and JG, the new reputation about the donor depends on the action of the 
donor (i.e., C or D) and the reputation of the recipient (i.e., G or B). When a recipient has a G reputation, 
observers assign G and B to a C and D donor, respectively, under both ST and JG. When a recipient has a 
B reputation, observers assign G to a D donor under both rules. The two rules are different in that helping 
bad individuals (i.e., donor's C) is appreciated (i.e., G imparted by the observer) under ST, whereas the 
same action of the donor is punished (i.e., B imparted by the observer) under JG; JG is sterner than 



ST 15 39 



After sufficiently many rounds of the donation game involving reputation updates, the reputation 
distribution in the eyes of each group-specific observer reaches a unique equilibrium. In the equilibrium, we 
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measure the quantities of interest such as the fractions of G players, the probability of cooperation, and 
their dependence on groups. 

Analysis Methods 

Equilibria of the reputation dynamics 

We examine the stability of a homogeneous population of DISC players. Each player bears a reputation 
vector, t — (ri,f2, • • • , tm) G {G, B} M , in the eyes of M observers, each representing a group. We denote 
by Pk(f) the probability that a player in group k has reputation vector r. By adopting the formalism 
developed by Ohtsuki & Iwasa |8j, we obtain the following reputation dynamics: 

d M 

- Pk (r) = - Pk (r) + ]T {6p k (r') + (1 - 6)p. k {r')} \{ ^ k ,{a{r' k ),r' k ,). (1) 

r'G{G,B} M fe'=l 

The summation on the right-hand side of Eq. ([I]) represents the average over the recipient's reputation 
vector r' . With probability 8, a game involves a donor and a recipient in group k, and the recipient has 
reputation vector r' with probability p k (r'). With probability 1 — 8, a donor and a recipient belong to 
group k and another group, respectively, and the recipient has reputation vector r' with probability 
P-k( r ') = 2fc'=i k '^ k Pk'( r ')/(M — 1). <j{r' k ) represents the action of a donor toward a recipient having 
reputation r' k . Because we assume DISC donors, cr(G) = C and c(B) = D. The reputation assignment rule 
is essentially given by $ rfc , {c(r k ), r' k ,) G {1 — fi, /i}, which is the probability that an observer in group k' 
assigns reputation r k i to a donor in group k. This probability depends on the donor's action cr(r£) toward 
a recipient having reputation r' k , in the eyes of the observer in each group k! . In Tab.JTJ we list the $ 
values under different assignment rules. It should be noted that all the observers are assumed to adopt a 
unique assignment rule; we do not assume that observers employ different assignment rules as in previous 
studies [7|[l2j[l3j[l5}[l6] . 

We reduce Eq. (JlJ to mean field dynamics of two reputation distributions. First, we apply summation 
= E n J2r 2 ' ' ' Er t _! Sr fc+1 ' ' ' J2r M to both sidcs of Ec l- Q to obtain the reputation dynamics in 
the eyes of ingroup observers as follows: 

^p in (r) = -p in (r) + J2 {Opin(r') + (l-e)p out (r')}^(r')y) ) (2) 

( " r'e{G,B} 

where Pm (r) = J2 r ^ k Pk{ r ) and p ou t{r) = J2 r _ k P-k( r ) are the probabilities that a player has reputation 
r G {G, B} in the eyes of ingroup and outgroup observers, respectively. The two terms inside the curly 
brackets on the right-hand side of Eq. (pi) correspond to the two situations shown in Fig. [3] (a) and (b). 
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With probability 9pi n (r'), the recipient belongs to the donor and observer's group, and has reputation r' 
(Fig. [3] (a)). With probability (1 — 6>)p out (r'), the recipient does not belong to the donor and observer's 
group, and has reputation r' (Fig. [3] (b)). 

Second, by applying summation £) r _ ( = E n Er 2 ' ' ' Er M E^ +1 " ' ' £r M ' where ^ Mo both sides 
of Eq. 0, we obtain 

^Pfc(^) = -Pk{n) XI 

r^e{G,B}r^e{G,B} 

1 1 



epkWy<) + (i-fl) 



$ r ,(a(r' fc ),^), 



_M- 1 V M ~ 1, 

where ?>fc(rj.,r^), pi{r' k ,r'(), and p_fe^(r^,,r^) are the probabilities that a player in group k, group £, and a 
group other than k and £, respectively, has reputation and in the eyes of observers in groups k and I. 
By approximating the three probabilities by Pm(r' k )paut(r'z), PoutW)PinW), and p ut(?l)]W W), 
respectively, we obtain the reputation dynamics in the eyes of outgroup observers as follows: 
d 



d -Pout(r) = -Pout(r) + 

r'£{G,B} r"G{G,B} 



> in (r>out(r") + (l-0) 



' Pout(r')Pi„(r") + f 1 - ) Pout(r>out(r") 



M — 1 ^ ' v ' V M — 1 



(4) 



The three terms inside the curly brackets on the right-hand side of Eq. Q correspond to the three 
situations shown in Fig. |3](c), (d), and (e). With probability 9pi n (r')p out (r"), the recipient belongs to the 
donor's group, which differs from the observer's group, and has reputation r' and r" in the eyes of the 
donor and observer, respectively (Fig. [3] (c)). With probability (1 — Q)[l/(M — l)]p ou t(r')p; n (r"), the 
recipient belongs to the observer's group, which differs from the donor's group, and has reputation r' and 
r" in the eyes of the donor and observer, respectively (Fig. [3] (d)). With probability 
(1 — 9)[1 — 1/(M — l)]p ut( r ')Pout( r ") , the recipient belongs to a group different from the donor's and 
observer's groups, and has reputation r' and r" in the eyes of the donor and observer, respectively (Fig. [3] 
(e))- 

By setting dp in (r)/dt — dp out (r) / dt = in Eqs. ^ and Q, we identify stationary points that are 
candidates of stable equilibria of the reputation dynamics. We examine the conditions det J > and 
Tr J < 0, where J is the Jacobian matrix, at each stationary point to identify all the stable equilibria. We 
confirmed that the stable equilibrium denoted by p* n (r) and p* ut (r) is unique under each reputation 
assignment rule. 



G 



Stability against invasion by ALLC and ALLD mutants 

We check the evolutionary stability of a homogeneous population composed of DISC players against 
invasion by an infinitesimal fraction of mutants adopting ALLC or ALLD. The payoff to a DISC resident 
player is given by 

^disc = (6 - c) 0pf n (G) + (1 - 6) P * out (G)] , (5) 
and those to ALLC and ALLD mutants are given by 

ttallc = -c + b [9pg(G) + (I - 0)p°t(G)] (6) 

and 

^alld = b [6pP(G) + (I - 0) Po D ut (G)] , (7) 

respectively. In Eqs. Q and Q, (G), P° u t(G), (G), and p D ut (G) represent the probabilities that the 
mutants selecting C and D gain G reputations in the eyes of ingroup and outgroup observers, and are given 

by 

pUG)= J2 {^(O + (i-0)riut(O}Ma,O 

r'G{G,B} 

and 

Po°ut(G)= £ 

r'e{G,B} r"G{G,B} 

*G(a,r"), 

where a = C or D. The population of DISC players is stable against invasion by ALLC and ALLD mutants 
if 

7r D isc > max{7rALLC,7TALLD} • (8) 

Cooperativeness 

DISC donors cooperate exclusively with G recipients. Therefore, at each stable equilibrium, the probability 
of cooperation, which we call the cooperativeness, toward ingroup and outgroup members are given by 
p* n (G) and p* ut (G), respectively. The cooperativeness for the entire population is given by 

^E^ n (G) + (l-%: ut (G). (9) 



M - 1 



P*out(r')pUr") + (1 - 



1 



M — I 



K ut (r'Kut(r") 
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Measurement of ingroup bias 

To quantify the degree of ingroup bias, we measure the difference between ingroup and outgroup 
cooperativeness, defined by 

P ^p* D (G)-p* out (G). (fO) 

When p«-l, players basically cooperate with outgroup recipients and defect against ingroup recipients, 
implying outgroup favoritism. When p 0, players equally likely cooperate with ingroup and outgroup 
recipients. When p ss 1, players cooperate with ingroup recipients and defect against outgroup recipients, 
implying ingroup favoritism. 

Results 

Table [2] summarizes the results obtained under the three reputation assignment rules. It shows the stable 
fractions of G players in the eyes of ingroup and outgroup observers (i.e., p* n (G) and Pout(G)), the stability 
conditions, cooperativeness (i.e., ip), and the degree of ingroup bias (i.e., p). 

IM 

Under IM, the equilibrium fractions of G players in the eyes of ingroup and outgroup observers are both 
equal to ip = 1/2. Therefore, ingroup favoritism does not occur, i.e., p = 0. Furthermore, the population of 
DISC players is invaded by ALLC mutants such that it is unstable. This result is consistent with the 
established result that cooperation is not usually stable under IM because observers do not distinguish 
between selfish defection (i.e., D against G recipients) and justified defection (i.e., D against B 
recipients) §[^[39)[40] . 

ST and JG 

Under ST and JG, DISC players almost always cooperate with ingroup recipients, i.e., pl n (G) = 1 — p. 
This result is consistent with the previous result that ST and JG enable perfect cooperation when a 
population does not possess group structure (corresponding to M = 1) [Sj[9] . 

The fraction of G players in the eyes of outgroup observers depends on the assignment rule. Under 
ST, the fraction is given by 

p * mt (G) = l-p 1 ^ + 0(p 2 ). (11) 

Therefore, DISC players almost always cooperate with both ingroup and outgroup recipients unless 9 is 
small (i.e., ip = 1 — pi/6 + 0(p 2 )). Because donors defect slightly more often against outgroup than ingroup 
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recipients, weak ingroup favoritism occurs (i.e., p = p,/9 + 0(/j 2 )). 

Under JG, the fraction of G players in the eyes of outgroup observers is given by 

Kut(G) = \- (12) 

Therefore, DISC players cooperate with outgroup recipients with probability 1/2. In contrast to the case of 
ST, frequent intergroup interaction considerably reduces cooperation under JG (i.e., ip = (1 + 0)/2 + p9). 
The degree of ingroup bias under JG is given by p = 1/2 — /x, which is independent of 9. DISC players 
show a significant level of ingroup favoritism, even though they simply use the reputations without 
intending to discriminate recipients by the group identity. 

Under both ST and JG, in particular JG, the ingroup favoritism emerges. This is because the donors 
(equivalently, ingroup observers) and outgroup observers generally perceive different reputations about the 
same player due to the assignment error (see Figs, [I] [3] (c), [3] (d), and [3] (e)). For example, if a donor 
defects against a recipient whose reputation is B in the eyes of the donor's group members, the donor 
receives a G reputation from the ingroup observer. However, if the same recipient has a G reputation in 
the eyes of the outgroup observer, the outgroup observer assigns B to the donor under ST and JG. As 
another example, if a donor cooperates with a recipient whose reputation is G in the eyes of the donor's 
group members, the donor receives G from the ingroup observer. However, if the recipient has a B 
reputation in the eyes of the outgroup observer, the outgroup observer assigns B to the donor under JG. In 
this way, different groups can often perceive the opposite reputations about the same players in a long run. 

We compare the theoretical results with numerical results obtained from individual-based simulations 
in Fig. |4j The procedure of the numerical analysis is described in Appendix. The analytical and numerical 
results are sufficiently close in terms of both cooperativeness (Fig. [4] (a)) and ingroup bias (Fig. [4] (b)). 

Under ST, Eqs. $5h, and Q yield the payoff differences given by 

^ALLC - ttdisc = | [6(1 - 9) - c] + 0(/i 2 ) (13) 

and 

ttalld - ttdisc = -(6 - c) + O(p). (14) 
Therefore, the stability condition (Eq. Q) reads 

Under ST, ALLC mutants invade DISC players if b/c > 1/(1 — 9). The cooperation under ST is stable up 
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to a large value of b/c when ingroup interaction is frequent (i.e., large 
population under a trivial condition b/c < 1. 

Under JG, the payoff differences are given by 



ALLD mutants invade a DISC 



1 



7TALLC — 7TDISC 



M9-1 
' M - 1 



0[p) 



and 

7TALLD — 7TDISC 

The stability condition reads 



1 + (M - 3)9 + M6 2 



M - 1 



c(l + 9) 



0(jjl). 



(16) 



(17) 



(M — 1)(1 + 6) 

1 + (M - 3)0 + M0 1 
(M — 1)(1 + 0) 



b M - 1 

< - < 



< 



1-M9 if °^<M' 



(18) 



1 + (M - 3)9 + M9 2 c 
The DISC population is resistant to invasion by ALLC mutants when 9 > 1/M, i.e., when ingroup 
interaction occurs more frequently than in the case of unbiased random pairing. When 9 < 1/M and 
b/c > (M — 1)/(1 — M9), ALLC mutants invade the population of DISC players. When 
b/c < (M - 1)(1 + 6)/[l + (M - 3)9 + M9 2 }, ALLD mutants invade the population of DISC players. The 
cooperation is stable down to a small value of b/c if ingroup interaction is frequent (i.e., large 9) or the 



number of groups (i.e., M) is small. In the limit M —¥ oo, Eq. (18) is reduced to b/c > 1/9, which coincides 



with the results obtained from a previous model with infinite groups 37 



Mixed Assignment Rules 

We have shown that JG leads to strong ingroup favoritism, whereas ST does not. To examine the 
transition between the two regimes, we consider an assignment rule denoted by MX, which is a mixture of 
JG and ST. In a one-shot game under MX, observers independently assign reputations by using JG with 
probability a and ST with probability 1 — a. Therefore, $g(C, G) = 1 — /x, $g(D, G) = /U, 
<I>g(C, B) = a,[i + (1 — a)(l — n), and < I ) g(D, B) = 1 — /x. Parameter a controls the degree of sternness with 
which observers assign B to donors that cooperate with B recipients. ST and JG correspond to a — and 
a = 1, respectively. We numerically solve Eqs. ^ and Q under MX. 

The results under MX are shown in Fig. [5] Sternness gradually decreases cooperativeness (Fig. [5] (a)) 
and increases ingroup bias (Fig. [5] (b)) for different values of M and 9. The results interpolate those for ST 
and JG and imply that sternness promotes ingroup favoritism. The shaded parameter regions in Fig. [5] 
(c)-(f) indicate the values of a and b/c for which DISC residents are stable. Above (below) the shaded 
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regions, ALLC (ALLD) mutants invade the DISC population. In all the cases, the upper and lower bounds 
of the stability region in terms of b/c increase with a. An increase in 9 induces cooperativeness, reduces 
ingroup bias, and broadens the stability regions. This is because, with large 9, players are largely involved 
in ingroup interactions such that they do not suffer from a B reputation that outgroup observers may 
frequently attach to the donor. A decrease in M induces cooperativeness and reduces ingroup bias. A 
decrease in M also broadens the stability regions if 9 is large. 



Discussion 

In the present study, we showed that ingroup favoritism emerges in a group-structured model of indirect 
reciprocity. In our model, players share information in each group but not across different groups. We 
assumed that the players' actions purely depend on the coplayers' reputations; players do not refer to the 
group identity of coplayers or use other types of prejudices. We also assumed that observers impartially 
assess ingroup and outgroup donors. Ingroup favoritism occurs under both simple standing (ST) and stern 
judging (JG) assignment rules. The cooperativeness is reduced by the frequent intergroup interaction, i.e., 
small 9. The ingroup bias is severer and the cooperativeness is smaller under JG than ST. The parameter 
region for the stability of the cooperative equilibrium is larger under JG than ST. Under ST and JG, a 
population of discriminators is evolutionarily stable if the probability of ingroup interaction (i.e., 9) is 
sufficiently large. If 9 is small, the population is invaded by unconditional cooperators and unconditional 
defectors under ST and JG, respectively. 

We implemented the group structure by controlling probabilities of ingroup and outgroup interaction 
(i.e., 9 and 1 — 9, respectively) and assuming the groupwise information sharing. In terms of the structure 
of information sharing, most previous theoretical studies of indirect reciprocity are classified into two types: 
public [3||4||6H8||9|[ll}|l4K37] and private [5j[7[|lO}[l4|[T6] reputation models. 

In public reputation models, all the players have access to a common information source that provides 
the reputation values of the players. Therefore, a donor and observer perceive the same reputation about a 
recipient such that they do not suffer from the discrepancy of reputations. In public reputation models, ST 
and JG realize evolutionarily stable cooperation [8l[9l. This result is consistent with ours because, in the 



limit — > 1, Eqs. (15) and (18 1 are reduced to a trivial condition b/c > 1 such that the population of 
discriminators is stable under ST and JG. 

In private reputation models, each player individually collects others' reputations such that the 
reputation about a player varies by individuals. In contrast to the case of public reputation models, a 
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homogeneous population of discriminators is invaded by unconditional cooperators in private reputation 
models. A mixture of discriminators and unconditional cooperators is often stable under variants of 
ST [5j[7)[l0|[l6]. Under variants of JG, a population of discriminators is invaded by unconditional 
defectors |14||16| (but see Ref. |10| ), or discriminators and unconditional cooperators are frequent in an 
island model if dispersal of offspring is confined within each island 7|. In the limit 6 — > and M — > oo, our 
model can be interpreted as a private reputation model. In this situation, the population of discriminators 



is unstable because Eqs. ( 15 ) and ( 18 ) are violated. Therefore, the results obtained from our model in this 
limit are consistent with the previous results. 

For intermediated 8 and M values, our model uses a public reputation scheme within each group and a 
private reputation scheme across groups. In this sense, the structure of information sharing in our model is 
situated between public and private reputation models. 



Group competition models of indirect reciprocity were previously studied 12 13 . The authors 
numerically examined competition among different assignment rules employed in different groups. In our 
terminology, they assumed that the donation game is played inside each group and that reputations are 
updated exclusively by ingroup observers under the public reputation scheme. They showed that JG 
(stern-judging in their terminology) emerges in the course of evolutionary dynamics based on group 
competition and individual selection. Their models and ours are fundamentally different although the 
relevance of the JG assignment rule is suggested by both studies. First, they assumed group competition 
and we do not. Second, they focused on competition of different assignment rules and we do not. Third, we 
determined the possibility of ingroup favoritism and group-independent cooperation. In contrast, their 
model is not concerned with ingroup favoritism because interaction between a donor and recipient in 
different groups is not assumed. 

Uchida and Sigmund analyzed competition of assignment rules by using replicator dynamics [15] . In 
their model, a player selected as donor uses the public information source corresponding to the assignment 
rule that the player adopts. For example, if the surviving assignment rules are only ST and JG (SUGDEN 
and KANDORI, respectively, in their terminology), there are two public information sources. Although 
their model is apparently a public reputation model, the players can be interpreted to belong to one of the 
groups defined by the assignment rule; members in each group share a common information source and 
adopt the same assignment rule. In their model, helping a recipient having a bad reputation in the eyes of 
both ST and JG groups is assessed to be good by the ST group and bad by the JG group. Therefore, JG 
players assess ST players to be bad more often than they assess JG players. Because this tendency is 
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strong enough, ingroup favoritism occurs in the JG group. Their model and ours complement each other in 
the following respects. First, they investigated competition among assignment rules, whereas we assumed 
that all the groups share an assignment rule. Second, they assumed a well-mixed population, whereas we 
allowed the frequency of ingroup and outgroup interactions to be tuned. Third, they studied competition 
among at most five groups (i.e., five assignment rules), whereas we assumed a general number of groups. 
Investigation of ingroup bias when different assignment rules may be used in different groups is warranted 
for future work. 



Conclusion 

To explore the possibility of spontaneous ingroup favoritism in indirect reciprocity, we analyzed a social 
dilemma game in a population with group structure. We showed that the degree of ingroup bias depends 
on the assignment rule. In particular, considerable ingroup favoritism occurs under the so-called JG 
assignment rule, with which observers assign bad reputations to players helping bad players. Ingroup 



favoritism has been considered to be an evolutionary outcome 21-23 25 29 . The present work supports 
this general idea. To measure the dependency of ingroup bias on the assignment rule in behavioral 
experiments may be an interesting challenge. 



Appendix: Procedure of the numerical analysis 

We prepare a population of N = 10 3 DISC players divided into M groups of equal size. We consider an 
N x M reputation matrix, denoted by R = (r^fc), where r^fe € {G,B,U} represents the reputation of 
player i (1 < i < N) in the eyes of the observer in group k (1 < k < M). U represents the unknown 
reputation. We assume that all the entries of R are equal to U in the beginning of a run. In a one-shot 
donation game, we randomly select a player % as donor. Then, with probability 8/(N/M — 1), we select a 
recipient i) that is in the same group as i's group. With probability (1 — 0)/(N — N/M), we select a 
recipient j that is in a group different from i's group. When determining the action, the donor refers to 
rj t k, where k is the donor's group. We assume that the donor cooperates when rjk — U. After the game, 
the observer in each group k (1 < k < M) assigns a new reputation to donor i such that = G with 
probability $g(g, r j,k) and r^fc = B with probability 1 — $G( a i r j,fc); where a S {C,D} is the donor's action 
and $G( a j r j,k) under each assignment rule is defined in Tab.JI] When rj^ = U, we assume that the 
observers use IM; $ G (U, C) = 1 - (i and $ G (U, D) = fi. We set fx = 0.01. 

After repeating T = 10 5 rounds of the donation game, we calculate the fraction of G players in group I 
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in the eyes of the observer in group k, which is given by $J )k (G) = £ i=1 . playcr i in group t 5(r iik )/(N/M), 
where 5(G) = 1 and 5(B) = <5(U) = 0. The fractions of G players in the eyes of ingroup and outgroup 
observers are given by $* n (G) = n,k( G V M and $ -t(G) - Ek=x iSLi&k ^,k(G)/[M(M - 1)], 

respectively. By substituting these quantities in Eqs. ([9| and | |10[ ), we obtain ip and p. We average tp and p 
over 10 2 runs of the simulation. 
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Figures 




Figure 1: Behavior of different observers in different groups (M = 3). 
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Figure 2: Three reputation assignment rules. Image scoring (IM), simple standing (ST), and stern 
judging (JG). The rows represent the donor's actions (i.e., C and D), the columns represent the recipient's 
reputations (G and B), and G and B inside the boxes represent the reputations that observers assign to the 
donor. 




Figure 3: Five possible situations of the reputation update. Observations are made by ingroup 
observers in (a) and (b), and by outgroup observers in (c), (d), and (e). 
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Figure 4: Equilibria of a population of DISC players under ST and JG. (a) Cooperativeness (ijj) 
and (b) ingroup bias (p). We vary the assignment rule (ST or JG), the number of groups (M = 2 or 10), 
and the probability of ingroup interaction (9). The lines represent theoretical results shown in Tab. [2] The 
symbols represent numerical results. 
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Figure 5: Equilibria and the stability conditions for a population of DISC players under MX. 

(a) Cooperativeness (tp) and (b) ingroup bias (p). In (a) and (b), we set (M,6) = (2,0.6), (oo,0.6), (2,0.2), 
and ( oo,0.2). (c)-(f) Stability conditions. The homogeneous population of DISC players is stable in the 
shaded parameter regions. We set (c) (M, 6) = (2,0.6), (d) (M, 6) = (oo,0.6), (e) (M, 6) = (2,0.2), and 
(f) (M,0) = (oo,0.2). 
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Tables 



Rule 


$g(C,G) 


*g(D,G) 


*o(G,B) 


* G (D,B) 


IM 


1 — fi 


/" 


1-/X 




ST 


1 — fj, 


/i 






JG 


1 — fi 




A* 


1-M 



Table 1: Probability that an observer assigns G to a donor. <&g(ci, r) represents the probability that 
a donor receives G when the donor selects action a £ {C,D} and the recipient has reputation r 6 {G,B}. 
The donor receives B with probability $b(o, r) = 1 — $G( a , r )- 



Rule 
IM 

ST 

JG 



Pin( G ) 
1 

2 



Pout( G ) 

1 

2 



Stability condition 
Unstable 



i 

2 



Eq. (151 



Eq. (181 



-o( M 2 ) 





o(m 2 ) 



Table 2: Equilibria and the stability conditions for a population of DISC players under different 
assignment rules. 
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